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d) after said transmitting or storing, in response to the resulting delayed audio, 
developing a second marker corresponding to said marker of c); 

e) in response to the relative timings of said marker of c) and said second marker, 
delaying the least delayed of said delayed audio and said delayed video. 

Claim 30. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video. 

Claim 31. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video. 

Claim 32. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video in an unobtrusive manner. 

Claim 33. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video 

Claim 34. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video as a watermark. 

REMARKS/ARGUMENTS 

Applicant believes authorization to charge deposit account 16-1940 for the 
additional claims presented herein was included with the application as filed, however 
in the event applicant is mistaken, please consider this statement an authorization to 
make such charges to deposit account 16-1940. 

Attached hereto is a marked-up version of the changes made to the specification 
and claims by the current amendment. The attached page is captioned " Version with 
markings to show changes made. " These changes include amending the specification 
to reflect the issuance of the parent application as patent 6,351,281 and the addition of 
new method claims recited in step plus acts form. 

It is noted that the parent application fully supports at least the independent 
claims 16-18, 28 and 29. For example, the particular limitation of providing a marker 
in response to the ancillary or audio signal in step a) is taught in the parent application. 
For example at column 4, lines 21-25 of the '281 patent issued from the parent 
application it states: 

Note that while an added pulse 21 from the generator 20 is 
preferred, certain parameters, characteristics or ancillary signals (herein 
called artifacts) already present in known signals could be utilized as 
tracker pulses 21. 
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The tracker pulse of '281 may take on many forms and corresponds to the marker of 
the present application. Additionally, the claim elements "parameter" of claim 19 and 
"characteristic" of claim 20 are taught in the parent application for example as in the 
section above. 

The claim 22 and 23 features relating to amplitude modulation of the marker and 
engrafting the marker on the luminous portion of the video is taught in the parent 
specification. For example '281 at column 4, lines 10-20 states: 

This tracker pulse is generated in recognition with the type of signal 
together with the processing which will or is expected to occur thereon. 
For example, with a NTSC video transmission system, the tracker pulse 
could be an amplitude modulated pulse engrafted onto the luminous 
portion of the signal. It is preferred that the tracker pulse be invisible or 
imperceptible to the ultimate use to which the signal will eventually be 
applied. 

This language also precisely fits the use of a watermark as in claims 24 and 25. 
Watermarks are commonly digital pulses which are added to the luminance portion of 
the video, i.e. while there are various types of watermarks, the luma is commonly 
amplitude modulated by the digital watermark information. The use of watermarks is 
also taught in the present specification, for example at page 11, line 10 et. seq.. 

A copy of 6,351,281 is enclosed for the examiner's convenience. 

Applicant respectfully requests that a timely Notice of Allowance be issued in 
this case. 



I hereby certify that this correspondence is being facsimile transmitted to the U.S. 
Patent and Trademark Office (Fax No. (703) 308,5399 on March 6, 2002. 




J. Carl Cooper 
Reg. 34,568 
(408) 871-1975 




J. Carl Cooper 
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In the specification: 

The first paragraph beginning at line 4 of page 1 has been amended as follows: 

This application is a Continuation In Part to S/N 09/119,524 filed 07/21/98, 
now patent 6.351 .281 issued 02/26/02 which is a division of S/N 08/620,126 filed 
03/21/96 which receives priority from provisional application 60/008,309 filed 
December 7, 1995, which applications are incorporated herein in their entirety and for 
all purposes as if they had been set forth in detail. 

In the claims: 

Claim 16. A method of determining the synchronization of a video like signal and at 
least one corresponding ancillary signal, which signals may suffer differing relative 
delays to become delayed ancillary and delayed video like signals, said method 
including the steps of: 

a) developing a marker in response to said ancillary signal; 

b) associating said marker with said video like signal: 

c) recovering said marker from said delayed video like signal: 

d) developing a second marker corresponding to said marker of c) from said delayed 
ancillary signal: 

e) determining said synchronization in response to comparison of the timing of said 
marker of c) relative to the timing of said second marker. 

Claim 17. A method of maintaining the synchronization of a video like signal and at 
least one corresponding ancillary signal which may suffer differing relative delays due 
to processing thereof which results in delayed ancillary and delayed video like signals, 
said method including the steps of: 

a) developing a marker in response to said ancillary signal: 

b) associating said marker with said video like signal: 

c) recovering said marker from said delayed video like signal: 

d) developing a second marker corresponding to said marker of c) from said delayed 
ancillary signal: 

e) in response to the timing of said marker of c) relative to the timing of said second 
marker, delaying the least delayed of said delayed ancillary and said delayed video like 
signals thereby correcting errors in said synchronization. 

Claim 18. A method of indicating the relative delay of a video like and at least one 
corresponding ancillary signals which mav suffer differing relative delays as a result of 
processing to become delayed ancillary and delayed video like signals, said method 
including the steps of: 

a) developing a marker in response to said ancillary signal: 
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b) associating said marker with said video like signal: 

c) recovering said marker in response to said delayed video like signal: 

d) developing a second marker corresponding to said marker of c^ from said delayed 
ancilla^ signal; 

e) indicating said relative delay in response to comparison of the timing of said marker 
of c) relative to the timing of said second marker. 

Claim 19. A method as claimed in claim 16, 17 or 18 wherein said marker of a) is 
responsive to a parameter of said ancillary signal. 

Claim 20. A method as claimed in claim 16. 17 or 18 wherein said marker of a) is 
responsive to a characteristic of said ancillary signal. 

Claim 21. A method as claimed in claim 16, 17 or 18 wherein said marker of a) is also 
res ponsive to said video like signal. 

Claim 22. A method as claimed in claim 16. 17 or 18 wherein said associating said 
marker with said video like signal of step b) includes engrafting said marker onto the 
luminous portion of said video like signal. 

Claim 23. A method as claimed in claim 16. 17 or 18 wherein said associating said 
marker with said video like signal of step b) includes engrafting onto the luminous 
portion of said video like signal by amplitude modulation. 

Claim 24. A method as claimed in claim 16. 17 or 18 wherein said associating said 
marker with said video like signal of step b) includes encoding said marker as a 
watermark in said video like signal. 

Claim 25. A method as claimed in claim 16. 17 or 18 wherein in step b) said marker is 
associated with said video like signal bv conveying said marker as a watermark in said 
video like signal and in step c) said watermark is recognized and said marker 
recovered therefrom. 

Claim 26. A method as claimed in claim 16. 17 or 18 wherein said video like signal 
and said ancillary signal are respectively video and corresponding audio parts of a 
television program- 
Claim 27. A method as claimed in claim 16. 17 or 18 wherein said video like signal 
and said ancillary signal are video and corresponding audio parts of a television 
program respectively and are encoded in MPEG form as part of said signal processing. 

Claim 28. A method of indicating the synchronization of the video and at least one 
corresponding audio portion of a television program, which video and audio may suffer 
differing relative delays due to transmitting or storing said television program, said 
method including the steps of: 
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a) before said transmitti ng or storing, developing a digital marker signal in response to 
said audio: 

b) carrying said marker with said video in said transmitting or storing: 

c) after said transmitting or storing , recovering said marker from the resulting delayed 
video: 

d) after said transmitti ng or storing, in response to the resulting delayed audio 
developing a second marker corresponding to said marker of c): 

e) indicating said sync hronization in response to comparison of the relative timing of 
said marker of c) and said second marker. 

Claim 29. A method of maintaining the synchronization of the video and at least one 
correspon ding audio portion of a transmitted or stored television program, which video 
and audio may suffer d iffering relative delays as part of said transmitting or storing, 
said method including the steps of; 

a) before said transmit ting or storing, providing a marker in digital form in response to 
said audio: 

b) carrying said marker with said video as part of said transmitting or storing: 

c) after said transmitt ing or storing, recovering said marker from the resulting delayed 
video: 

d) after said transmitti ng or storing, in response to the resulting delayed audio. 
developing a second marker corresponding to said marker of cY 

e) in respo nse to the relative timings of said marker of c> and said second marker 
delaying the least delayed of said delayed audio and said delayed video- 
Claim 30. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video. 

Claim 31 . A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video. 

Claim 32. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video in an unobtrusive manner. 

Claim 33. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is combined in the active portion of said video 

Claim 34. A method as claimed in claim 28 or 29 wherein as part of step b) said 
marker is engrafted onto the luminous portion of said video as a watermark. 
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DELAY TRACKER Tht audio and secondary cm the other hand usually 

are passed through devices which have relatively little delay 
This is a divisional of copending application Scr. No. compared to the video (although delays may be present due 
08/620426 filed on Mar. 21, 1996. to processing similar to the video outline above). Frequently 

prm n ap thp iMVPMTTnM 5 there are several audio channels, for example 2 channels of 

FIELD OF THE INVENTION English, 2 channels of another languigc, a data channel and 

This invention relates to a method and apparatus for a control channel. However, when the video signal and the 
accurately ascertaining the processing delay of a signal. It is auxiliary Bignals experience relative timing variations due to 
particularly useful for synchronizing a multiplicity of the changing delays of the different paths, problems occur, 
signals, some of which may have passed through processing 10 the most commonly noticed one being lip sync error when 
(including transmission systems) having delays, in order to the video is delayed with respect to the audio, 
resyncfaronize the signals at a known point in time. This Variable delay devices exist for delaying signals and it is 
application claims priority to the provisional Application possible at any point in the system to delay the earlier 
60/008,309 aied Dec 7, 1995— Multiple Video Input Delay anivmg(typicaUy audio) signal® to match the later arriving 
Measurement System, J. Carl Cooper inventor. 14 (typically video) signal However, the problem in making 

tw™^«^.*^ . such corrections arises in detecting the delay of the later 

BACKGROUND OF THE INVENTION (typically video) signal which is output from the system. 

A problem exists in many systems when the various This problem is compounded because the relative delay is 
primary and related signals are processed (including by constantly changing: the delay is often instantly changed as 
transmission and by storage, either direct or indirect, within a signal ts routed through different processing devices, and 
a facility and/or to/from a facility). Examples include video 20 di ^ creat oncs of me many input signals are selected to be 
systems wherein there are many video and/or audio signal P** 56 * 1 to the output. 

sources from television cameras, tape recorders, direct Vs - Pat No - 5*202,761, Audio Synchronization 

feeds, remote feeds from microwave and satellite, not to Apparatus, is an attempt to solve some of these related 
mention what might occur to the signal-wise reduction, P 10 ****- In this '761 patent, a puke was added only in 

synchronizers, traiiscoders, switching facilities, obscenity 25 F*? 1 * 0 ? £ ^^ ko ^fj aDd . thon "*f m vttl3a \ 
drop circuits, etc interval. It therefore would wait until the next vertical 

iL ; ^ .* „ . , . , . , interval to add a pulse in the vertical interval This would 

Tht uyeotiou is speedy usable m respect to television function within a certain given accuracy. Since ill of the 
signals and will be Ascribed with such signals for a pre- video inputs may be totally asynchronous some video sig- 
rerred embodiment. For example, a problem exists in many ^ mis might have their vertical interval pulse added immedi- 
telcviswn facilities when the various video and audio signals itely. However, others might have to wait nearly a whole 
arc processed within the station (or from facility to facility frame to have their pulse added. This gives rise to an 
for thit matter). There are also many video signal sources; inherent one frame inaccuracy. Parmer, various devices exist 
from television cameras, video tape recorders, remote feeds which over write or remove the vertical interval, severely 
from microwave and satellite, together with signal manipu- 3S compromising the *761's performance, 
lations such as noise reduction, etc There are also many These problems are not true in the present invention. In 
audio signal sources; from microphones, tape recorders, this invention, the delay of the signals which pass through 
remote feeds, etc. subject to their own similar processing. the systems are measured through the use of a delay tracker 

Television facilities utilize routing switchers in order that which is associated with the signal. This delay tracker is 
the video and audio from any source may be connected to ^ carried with the signal through the system so that, when the 
the input of any video or audio device respectively, with the selected one of the possibly many input signals is output 
outputs of those devices also being connected to the router from the system, the presence of the delay tracker can be 
so lhat the video and audio can be connected to tbe input of detected for that (those) signals) by themselves or in 
any other instrument. Tbe video and audio may, and fre- combination with other signals. In a preferred embodiment, 
quendy do, take entirely different paths having entirely ^ * <klay measurement circuit means receives the delay 
different delays. These paths can include many forms of tracker (directly or indirectly as later set forth) and starts 
active and/or passive delays. counting time. When the delay tracker is detected on the 

It is not uncommon to have a 64 by 64 matrix for each of si S nil out of system, a delay tracker detected signal is 
the auxiliary and video signals. Hie output signal is fre- seat to ^ delay measurement circuit which then stops the 
quently changed in delay by selection of different signal 50 mBC count The time at tbe stop is thereby a measure of the 
processing paths and selection of different ones of the input delay of the signal through the system. This measure of 
signals to be output These router systems give literally cgn men subsequently used, for example to adjust tbe 

hundreds of possibilities for signal path combination*, with synchronization of the various signals or otherwise, 
the paths being frequently changed to facilitate operational ITieory of Operation of the Delay Tracker System 

needs, differing network feeds, local feeds, differing active « » . - « B . , , . . 

processing circuits, eta In order to measure the delay of the signal which passes 

Frequently, the video processing path involves several 
devices which can have one or more frames of delay. Many . *?7- .t kD0Wn *? mi °/ P ^ B ^J^ J J^ A 
of these devices will have a changing deity as the mode of P °*J m ^S^^^t^ ™° 6cU ^ 

operation is changed by the operated, as toe phase of the «, JL^JT* *° T^' 80 

ioWng video signal drifts wuh respe^to o^r vk^ elected one of me many input signals is output from the 
• * >** «iw „ ****** system, the presence of the dcLav tracker can be detected and 

signals or to tte systems reference, or otherwise Examples r £^ cd £ r Mmt ^ V 
include noise reduction systems, synchronizers, transcoders, 

drop out compensators el aL OBJECTS AND SUMMARY OF THE 

It is not unusual for the video to suffer delays ranging 65 INVENTION 
from near zero to 10 frames of delay or more — U. 032 It is an object of this present invention to provide an 
seconds before the signal exits the system. improved apparatus and method for detecting and compeo- 
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2!'^,^^ * p r rocessm « v ^us signals information about which it is at some time in tbe signals life 

including tbe transmission thereof, appropriate to measure or determine a delay. 

Another object of the present invention is to provide an The tracker pulse generator 20 is designated to develop a 

improved Apparatus and method for detecting the delays of tracker pulse for the system. While called a pulse for danty, 
signals utilizing active portions thereof in order to ensure * may actually be any type of signal, for example code,' 

that the delay tracker passes through the processing means. frequency, bum or alteration of the signal 11, as will be 

A former object of the invention is to use recognizable dcscrfl>cd * m n"** detail below. Further, the tracker pulse 

tracker pulses to track a signal through processing. could be a coding oraitir^plaosdoo the signal by already 

An additional object of the present invention is to allow ?^ tD if? tt ^ m f nt ' ^ described in more detail 

for the rwynchronization of a plurality of signals at a known 10 This tracker pulse is generated in recognition with the 

location even after processing typ* signal together with tto processing wtiich will or is 

Aiwtw «k;«* «f a. ~~Z-4 • * •_. - expected to occur thereon. For example, with a NTSC video 

. r^^^ J P ^ invention is to provide for transmission system, the tracker pulse could be an amohruS 

a method and apparatus of oeteeting and compeiisatmg for modulated putoHngrafted ^KZrSft 

Further objects of the present invention is to provide for or more extra bit(s) or byte(s) engrafted onto the string of 

a method and apparatus usable with a wide variety of signals digital coding as appropriate for the type of coding. It is 

having differing frequency content including video signals, preferred that the tracker pulse be invisible or imperceptible 

audio signals, microwave signals. X-ray signals, and other to the ultimate use to which tbe signal wOl eventually be 

si S Qala * 20 applied. As later described, this can be provided through 

Other objects and a more complete understanding of the subsequent pitrcssiog as well as careful design. Note that 

invention may be had by referring to the following descrip* whOe an added pulse 21 from the generator 20 is preferred, 

tion and drawings in which: certain parameters, characteristics or ancillary signals 

(herein called artifacts) already present in known signals 

BRIEF DESCRIPTION OF THE DRAWINGS 25 could be utilized as tracker pulses 21. For example,^ 

Tbe structure, operation, and advantages of the presently ^ ^uJ™^} ^^^J**^ this 
disclosed preferred embodiment oftbe invention wiE c «* 0 . cou ^ bc « tracker pulse, Tb utilize the 

become apparent when consideration of the following !™ acts prc ^ nl » * e »** 51 « nal **. the artifacts 

description b taken in conjunction with accompanying w ^ ^in^ET* ***** * the location of the 
drawings wherein: 30 C0mDincr W» ^ recognized artifacts then being passed 

Pin 14-. ki~4, ai c u • . .I , , to the pulse detector in order that Ibe pulse detector measure 

min; ' cmbodm * Ql of the distance in time between the arrr^al c4 the artifects^m 

m _ 7\ , specific that passing through the processing means 30 from 

WO. 2 » a block diagram like HO, 1 of a two signal that which is otherwise being passed to the pulse detector 
embodiment of tbe invention; 35 TTuscanbe direcdy (line 22 in FIGS. 1 and 2) or indirectly 

FIG. 3 is a block diagram like FIO. 1 of a modified (** **gnal 121 on signal 115 in FIG. 2). Further note that a 
embodiment of the invention; known clocking circuit can also be utilized to provide 

FIG. 4 is a block diagram of a video prc<essing system coding for the tracker pulse 21, thus eliminating tbe need for 
including the invention; and vm tracker pulse paths to the delay determination circuit. 

HO. 5 is a block diagram of a multiple input delay 40 ^ }** N ^°°^ Bureau <* Standards time 

tracking system signal was utilized for coding, it would only be necessary for 

Ibe signal(s) being tracked to carry the tracker pulse: the 
DESCRIPTION OF THE PREFERRED N3& time signal could be separately and directly acquired 

EMBODIMENTS OF THE INVENTION ** |D0 ^termination circuit later described (as via box 

. . , as 23 in FIO. 2). Ibis would preferably be utilized for non- 

The deUy tracker system includes a combiner 10, a archival delay tracking of individual signals. (If multiple 
JEldS^ 8 ir^ processing mesas 30, a tracker signals were beinglrSxssed, tbe deUy^ternUnation 
tot?£ C £ ^'L^^ T^ 150 J* aUSC cuit could subtract one count and/ortimi code from another 
60 for the delay establisbed through use of the tracker pulse count and/or time code to process same, thus effectively 
^riua. 1 ana 3). 50 ignoring aoy common delays— even if measured in years). 

. A combiner 10 serves to associate the tracker pulse from A specialized system wide coding or timing source would 
the tracker pulse generator 20 with an input signal 11. Tbe have tbe same result for such a system, albeit not as 
input signal may be any type of signal, whether amplitude, universal. 

rrco^ency, phase, digUally coded, or otherwise existent. This The delay tracker system is designed to be used with a 
signal 11 includes video signals, audio signals, microwave s$ processing means 30 which preferably has a known maxi- 
signals, x-ray signals, digUalized signals (whether by mum delay. The reason this is important is that it is preferred 
amplitude, wulth, or other coding technique), and other that tbe tracker pulse be generated at a rate compatible with 
types of signals having desired information thereon tbe maximum delay in the system. If greater accuracy is 
(including information). The signals may be single, desired, the tracker pulse generator 20 would produce or use 

related multiple signals, unrelated multiple signals, or any so a nmttiplkity of distinct tracker pulses at a faster rate. Since 
cOTbmanoo thereof including series and parallel forms. (be multiplicity of pulses are distinct in coding, location, or 
Further, this signal can be acquired for use and used with the other ascertainable attribute, they can be separately tracked, 
invention at any point during its creation, subsequent thus significantly reducing the apparent effective time 
processing, or usage mchidmg separate intermediate stages between tracker pulses. Tnis would allow a single signal to 
thereof. For clarity, the signal U will be discused primarily 65 be tracked with a great precision. This would also allow for 
as a video signal. It is to be understood, however, that this multiple signals to be separately tracked through a single 
terminology includes ant type of signal which contains system. It would also allow a signal with uoknowo dclr/to 
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bo tracked by using the next recognizable tracker code at the desired to track the four Analog signals in respect to tip 

poise detector before rescuing Note that the tracker pulse video signal Note, in this respect, that since there is rcla- 

generator 20 can be separate for each signal which is passed tively little delay in tho audio signals, it would also be 

through the system (FIG. 1), or a single tracker pulse possible to use a single tracker pulse for all four audio 

generator 20 can be utilized for a number of differing 5 signals. As an additional example, if a time code on a video 

signals. signal was to be used as an tracker pulse, differing time 

The combiner 10 associates the tracker pulse 21 with the cales couldbe used as the tractor pubes for the four audio 

uKomins signal 11 While this pulse 21 could be at anv signals respectively — thus allowing the delay of the video 

loca£7raT incomes signal 61, it is preferred that tfa*. ^^^^^ ca ^ Bxia " speeitoead,ot 

combiner 10 place the tracker pulse 21 at a location where 10 — Jl ™ „ 

it is unobtrusive, invisible or imperceptible. Una can be The sig»»l 12 output frorn the combiner 10 is subject to 

passive (for example placing a video tracker pulse into mo subseq^processmg 30, which processing may occasion a 

overscan" area of a ^CWivision sigrul) or active (using ***** t^ signal. As previously set forth, Ub preferred that 

an otherwise visible single poiEt oHoimiee, preferably expected maximum of this delay be known m order to 

displaced from the ceottal areTperbaps with a subsequent « «^ the pulse generator 20 to insert tracker pulses 21 

drop out compensator or avaagkVmecfaanism to^ectively " a rate sW than the maxinruxo delay u the system. Note, 

remove the utifacts from Se pulse at . downstream tot 1"" ms5dm " m ^ * difficult or not able 

locujonv to be accurate ty ascertained, the system could utilize a 

. , ...... , , , . , . . multiplicity of ever more widely separated recognizable. 

Note that HxlrvKhud types of de .y t mcke, conA.ners cao tndCBT >t least one of which hasVdelay 

be designed for each type of B1 gnal which is being used, for 20 u«o the practical theoretical delay for any type of 

e^e analog or digital (as appropriate) versions 0 f Mez described puke detector 40 

tTTSC, PAL, component, composite, compressed, serial. would, once the delay had been determined, preferably reset 

parallel, time sequenUal. e^ since mn^ systems multiple (L e. ignore the trailing pulses 21 of the same multiplicity or 

fonnsofargoals are used ard traescoded from or» form to ^ UgirTpoccssing anew with that pulse). TbesT distinct 

anomer. tracker pulses 21 can be used in aggregate to more 

The combiner 10 associates the tracker pulse(s) 21 at a closely track the delay in the system, by using differing 
known location or position in the signal 11. As this point cm distinct tracker pulses to measure the delay within the 
be accurately determined for use later in the processing maximum delay in the system or by using again a multi- 
system the pulse Zt can be subsequently detected. Note (bat M phciry of tracker pulses like a venier to ascertain delay, 
it is preferred that the combiner 10 add the tracker pulse 21 Further, in certain systems, the tracker pulse 21 might have 
in an active portion of the incomfogviito signal. This would to be refreshed at an intermediate point For example in a 
allow the Vertical and horizontal intervals to be utilized for digitally encoded audio signal subject to error correction, 
other unctions and/or allow transcoding and other modifi- there is a theoretical limit that the pulses cannot vary by 
cations to the nature of the signal Again, if the tracker pube M more than one naif of the clock rate. The reason for this is 
was an artifact, time, frame count or other attribute already that, under this circumstance, an error correction circuitry 
present on the signal, this information would be developed could wipe out the signal. With this knowledge, it would be 
by the user for recognition by the cmnbincr 10, with this possible to incorporale an intermediate pube detector sys- 
information being passed to the remaining circuits (for tern with the error correction circuitry in order to ensure that 
example by line 22 in FIG. 1 or 121 in FIG. 2) as appropriate ^ a fresh tracker pulse is always present on an audio signal, 
for use as a recognizable tracker pulse. The prc<*ssing system 30 typically adds a delay to one or 

In the delay tracker system it is desired to add the delay more signals in the system, delays that can differ between 

tracker signal at some invisible or unobtrusive part of the signals. This processing system 30 can be transmission, 

video signal or date stream carrying the image. Vertical record/playback, store/reproduce, transcoding, 

blanking or other non-imago area may be used. However in 45 syrichrooization, noise reduction or any other sort of action 

some systems vertical blanking or various non-image data is which is taken on the signal 12. Some of these events might 

stripped off which would cause the delay tracker signal occur relatively simultaneously (multiple sound rooms for a 

therein to be lost. In these systems, the delay tracker signal single live radio broadcast) — while some might occur over 

would preferably be placed in the active image area of the a significant period of time (the archival presentation of 

video signal, for example in one of the extreme corners, jq video tapes with voice over audio). However, as long as the 

Since virtually all television receivers are overscanced, the tracker pube 21 is located on the signal 12, the amount of 

added delay tracker would not be visible to the home viewer. delay will be able to Accurately determined no matter what 

Furthermore, if the delay tracker signal is placed in the the processing. 

active video area, then as the video signal is converted bom Subsequent to processing, the now delayed signal 13 is 

one form or format to another, for example from PAL to 55 present in the system. This signal 13 may be present after all 

NTSC and vice versa, the delay tracker signal will be final processing, or may be mtermediate to a series of 

preserved as part of the image. processing steps. 

If multiple tracker pulses were to bo utilized with a single The signal 13 is interconnected to a pulse detector 40, 

input signal, it is preferred that the tracker pulses 21 be which pulse detector 40 serves to recognize the tracker pulse 

located at distinct locations on such signal or bave such 60 21 which is on the delayed signal 13. The pulse detector 40 

distinct attributes that they can be accurately, separately be is designed to recognize the particular type of tracker pulse 

recognized by the later described pulse detection circuit For 21 which is present on such signal 13. In the case of multiple 

example, if one were to track four analog audio signals with tracker pulses, the pulse detector 40 would either recognize 

a single video signal, the tracker pulses could be put in a) the its own pertinent tracker pulse 21 while ignoring other 

four various quadrants of the video signal, b) one in the 65 tracker pulses that may be present on the signal or, in the 

active picture, one in the overscan, one in the horizontal sync case of multiple tracker pulses for a single signal, would 

period and one in the chrominance, or c) otherwise as react to the multiple tracker pulses even if these tracker 
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^Sfn 2 }r£J^Vt P f^ ly S?^ Not ° * pulse coding based on a large scale technique. 

S ^^Y^^ ltr ?$ T 5 * m Examples would include the US. GoveTnmem N.B.Ttime 

s^ne^ 2* ares rr °, r H a *?tZ ^ 

Once tbetracker pulse has been detected, the detector X £fE ^ 
output 41 is used (FIO. 1). Vm use couXoodifVii«lto ? (BhoWD ^G. 2> using such a coding 

main signal containing the tracker pulse in sWifnnVr £? ^ U » P^SfT* ^ ^<^'P*f° 
(such as repeating or dropping video frames or altering the ST .u • 5 mdu ! Ctly . {ll0C m > P** 1 ^ P 1 ™***** system 
relative processing delay to compensate Ibr the delay), by IT""^ information is separately acquirable. This would, 
modifying another signal (such as deUy an audio track to mr example, be appropriate for measuring delays over vast 
synchronize it with a video track) or otherwise as desired. processing networks or within a particular networks own 

In the preferred embodiment shown, the detector output attribution system. 
41 is passed to a delay determination circuit 50 (FIG. 2)* 1x1 certain instances, the detenmnanon of tbe delay could 
Also input into tbe delay determination circuit 50 Is a further 15 be an end in itself. For example, tbe delay can be used as a 
signal having a relationship to the tracker pulse 21, which measure of quality or efficiency of processing 30. More 
further signal has something with a previously predeter- typically however, the amount of delay once developed is 
mined and thus ascertainable known relationship with the utilized insome sort of use 60. This could include providing 
signal U which was subject to processing. If the tracker * readout of tbe relative* delay, resynchionizmg the signals 
pulse 21 is coded with certain specific inforoiatfoD— for 20 by delaying a secondary signal UB, further processing a 
example, the specific point of a specific line of a television delayed signal 13 or another third signal, or otherwise as 
screen or a SMPTE time codo — it is only necessary that the appropriate. A typical use 60 for the invention would be to 
further signal contain the something reflecting the same provide a delay 70 in a signal path, preferably a faster 
relative information. Since the further signal would arrive at secondary signal 136 path, such that the delay determination 
the delay determination circuit 50 prior to the tracker pulse 25 circuit 50 controls tbe delay 70 (shown in dotted lines in 
output signal 13 (the reason being the slower than the FIG. 2) in order to provide a known relationship between the 
maximum delay) the delay determination circuit 50 can then two 13 and 1136 at this particular point in the system, 
compare tbe timing of the output signal 13 to the further Agood method of rcsynchrooizing signals is set forth in my 
signal in order to ascertain relative delay caused by the co-pending Application 08/486,000 Improved Program 
processing system 30. 30 Viewing Apparatus, the contents of which are included by 

This signal may take many forms. Examples include the reference, 
direct passage of an tracker pulse to the delay determination If the tracker pulse 21 was present on the delayed signal 
circuit 50, the passage of an tracker pulse on a second signal, 13 in a form which would be perceived and/or compromise 
the acquisition of tracker poise information from a second „ the ultimate use of the signal 13, an optional concealer 
source, or otherwise. circuit 80 could be utilized intermediate the pulse detector 

In respect to the direct passage of an tracker pulse, this 40 and the output signal 113 A. This concealer 80 would 
would occasion an fatcrcoonection between the pulse gen- remove or otherwise reduce the negative effects of tracker 
era tor to the delay o^ termination circuit 50 (line 22 in FIO. P 1 "* 6 21* An example would be with an error control circuit. 
2)> This would, for example, be appropriate for tracking a ^ This circuit replaces the delay tracker signal with a video 
single signal through processing, with or without subsequent signal which is taken from tbe preceding line of video or 
manipulation of such signal. other suitabto video as is well known. This replacement may 

In respect to the passage of an tracker pulse on a second be performed with a standard Dropout Compensator (DOC), 
signal if desired, in addition or instead of tracker pulse The DOC receives a signal indicating the position and 
coding, the tracker pulse generator 20 could send a secood- 43 occurrence of tbe delay tracker signal from the delay tracker 
ary tracker pulse 121 to a secondary combiner 106 on tbe detector to cause tbe concealment of tbe delay tracker signal, 
secondary signal 116 (FIG. 2). Under these circumstances, It could also include means to conceal the tracker pulse — for 
the delay determination circuit 50 would compare coded example, by modifying or averaging the pulse 21 with other 
tracker pulses from two detectors 40, 406 in order to surrounding signals to reduce its obtrustveness. A oVopout 
ascertain the relative delay between tbe signals 13 and 136. & compensator would accomplish this purpose in a video 
This would, for example, be appropriate for delaying the circuit application. 

faster signal (136 in FIG. 2) by a delay in order to synchro- There are many modifications and permutations which 
mxo tbe two signals 13, 136. can be made to the invention of this application without 

Note that when two signals are known to be tracked for a turning from its teachings. Examples are shown in FIGS. 3, 
stgfuficaciterigmofu'me,encodfa^ 55 4, and 5. 

its data on the associated second signal would provide for a u FIG. 3, there are two signals 11 and 116 which are 
higher aegree of accuracy than merely passing the tracker being separately tracked through a processing means 30, 
il^r^ ** Uy * tc ;™ R t n t^Jt 306. T^proccLing means caX a skgSSd process: 
1^*% 1 ^ aSSOCiatcd ^ ltficlf . be mg mctns for both signals, optionally, the^second signal 116 

1 u Mm S. mn ? Processing delays, processing « could pass through a separate processing mcans306 (as 
Si ^tr^ T h fT * ^ T *°«* *>* ^mL^ their oL ur^uelrX 
™^h^? y *?™^ • C ! rcUlt .- P^«°ner.tc«2MG*. If a^d.asyncfaroSzScouId 

^nTim rJ™^ be the audio of a television circuit be added to cordate the tracker pulses 21, 216 in a predict- 
being run through its own ooise reduction processing circuit able manner. This could include full synchronization 
pnor to being reasserted with the processed video signal „ (althougbin this situation,!! might be simpler to use a single 
w respect to acquisition of an tracker pulse from a tracker pulse generator fox both signals), it could be with a 
secondary source, this would result from the use of an known relationship between the two pulses 21 and 21a (for 
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example, to compensate for the repetitive nature of the be, one of the signals being processed). When the proper 

signals and/or the differing delays to be expected in the video location is present, the combiner 10 encodes the then 

processing means 30, 306), or otherwise. The use of the current count in the input signals) at the appropriate 

separate tracker pulse generators 21, 21b is preferred in that position, for example in the active video, overscan, the 

it allows each signal 11, 116 to be uidrvidualry tracked (ie. 5 vertical blanking or otherwise as desired, 

recognized by their respective pulse dctectots 40, 406). lb allow for processing of the tracker pulse 21, it is 

The two tracker pulses 21, 21b are detected by their appropriate to have a capacity to count greater than actually 

respective pulse detectors 40, 406 in order to determine the expected to allow for tolerances and operational speeds of 

appropriate delays between the tracked signals* This is the the system. Note abo that if an incompatible video or other 
relationship between signal 13 and 136, the relationship 10 auxiliary signal incorporated the tracker puke appropriate 

between signal 136 and signal He, and (indirectly) the coding suitable for the signal may be required. For example, 

relationship between signal 13 and signal lie By varying if an analog audio signal would cany the tracker pulse 21, 

the interconnections of the various delay determination an intermittent high frequency canier of 22 khz could be 

circuits, other variations are also possible. utilized to carry the same example 12 bits of information 

Once the delay is determined, it is again utilized. In FIG. 15 with suitable accuracy. 

3 U is used to synchronize the signals 113 and 1136 and to The tracker pulse signal 21 shown in FIG. 5 is as set forth 

synchronize the signal 1136 and 113c. a binary number which is clocked by a reference video H. In 

An optional coordinator 45 keeps track of the respective to™ system with multiple asynchronous video signals, the 

tracker pulses 21, 216. This would allow the operator to keep count is locked to a reference (in this case a reference video 
track of the actual signals which are passing through the 20 signal 15), and the same binary count is applied to all the 

pulse detectors 40, 406, thus providing the operator with delay tracker combiners 10. When the count is subsequently 

information which would be otherwise not readily available. recovered from the delayed video by the detectors 40, it is 

They would also allow an operator to syrKhronize signals subtracted from the current count by a delay determination 

113 to 1136 and, in addition, to signal 113c. Other types of circuit 50 including a difference calculator to give the 
multi signal synchronization and compensation could also 25 number of video lines of delay which the video signal has 

be occasioned by this system. experienced in the system. The lines of delay ascertained by 

FIG. 4 reflects a further implementation of the Invention, ^tanninator 50 are converted to milliseconds, seconds 

A tracker pulse generator creates the tracker pulse 21, The or other suitable delay measure and a delay signal is output 
particular tracker pulse 21 is generated in response to a video « to drive i matching delay 101 in an auxiliary signal path, a 

signal 11, for example every 10 frames. Further, by using an delay such as the Pixel Instruments AD3 100. Again, audio or 

additional circuit (a line counter 27 shown) the tracker pulse Qlhci "udliary signals could also be used with the system, 

can be combined with the line number and timing infbrma- It is preferred that all of the video signals carry the 

Uon 28 of the video input 11. This allows the tracker pulse encoded delay tracker signal through the video processing 

21 to be specifically coded with this pertinent information* 35 system so that, no matter which signal is selected as the 

thus creating a distinct and recognizable pulse, a delay output, there win be a delay tracker on it allowing the delay 

tracker. The particular tracker pulse 21 shown thus includes to be measured. In the event a signal without a delay tracker 

a binary count which is incremented at the H rate of the B output, the difference calculator can be preset to output a 

reference signal. Thus there is a unique binary number for default delay value, which may be preset or operator adjust- 

every line of video, and a unique number corresponding to 40 aWc - 

the time when the signal is added to video. The combiner 10 This system has some real advantages. First, it is cheap to 

encodes the current delay tracker in the video frame during implement for multiple video signals. The delay tracker 

which the tracker pulse 21 was received as previously set combiner cost is divided by $250 per video channel. The 

forth- delay detector and calculator is around £4,500. Of course, 

After the tracker pulse 21 is combined with the input 45 onlv one delay detector is needed per system although more 

signal 11 it is passed through the processing means 30 in the CMn b0 used for corrections at intermediate points, 

customary manner. Subsequently, the delay tracker detector Although the invention has been described in its preferred 

40 ascertains the delay occasioned by the processing aod, in form with a certain degree of particularity, it is to be 

addition, replicates the line number corresponding to the understood that numerous changes can be made without 

location of the delay tracker signal(s). This information is so departing from the invention as hereinafter claimed, 

then used as appropriate to ascertain the delays in the What b claimed is: 

system. In addition, the concealer circuit 60 removes or 1. In a signal processing system having a signal having 

otherwise reduces negative effects the delay tracker signal so desired substantive information thereon passing through a 

as to provide for an uncorrupted video output. delay, which delay may change, 

In FIG. 5, a system amplifying the device of FIG. 4 is 55 the improvement of a delay tracker, said delay tracker 

shown for one video channel (parts of this system are comprising a tracker pulse, means to associate said 

duplicated for each channel). In this device again a sync tracker pulse with the signal having desired substantive 

stripper and line counter keep track of which line of the information thereon, 

video signal is currently present for use on the tracker pulse a pulse detector means, means to associate said pulse 

21 (ref video 15 in). The particular preferred embodiment 60 detector means with the processing system and said 

counts at the horizontal sync rate to develop a specific count pulse detector means recognizing said tracker pulse to 

for the tracker pulse 2L The actual count would vary with develop a determination of the delay of said tracker 

the anticipated maximum delay of the processing 30. For a pulse. 

typical NTSC system having a horizontal characteristic of 2. In a signal processing system having a signal having 

525 lines per frame, 2625 counts would allow a 10 field « desired substantive information thereon, the signal having 

delay (or 12 bits of binary information on the tracker pulse desired substantive information thereon may have a chaog- 

21). (Mote this reference video can be, but does not have to ing delay due to changes in the processing system, 
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the improvement of & delay tracker, said delay tracker 
comprising a recognizable tracker pulse, means to 
associate said recognizable tracker pube with the signal 
having desired substantive information thereon, 

a pulse detector means, means to associate said pulse 
detector means with the processing system and said 
pulse detector means recognizing said recognizable 
tracker pube and further operative to develop a mea- 
sure of the delay of said tracker pulse. 

3. In a signal processing system having an incoming 
signal having desired substantive information thereon pass- 
ing through a processing means having a delay, which delay 
may vary in respect to differing signal processing systems, 

the improvement of a delay tracker comprising a tracker 
pulse, 

a combiner means to associate said tracker pulse with the 
incoming signal having desired substantive information 
thereon prior to the incoming signal having desired 
substantive information thereon passing through the 
processing means, 

a tracker pulse detector means to recognize said tracker 
pulse on the signal having desired substantive infor- 
mation thereon coming from the processing means and 
to determine the delay of said tracker pulse, and use 25 
means responsive to said tracker pulse detector means. 

4. The delay tracker of claim 3 characterized in that said 
use means includes a delay determination means determin- 
ing the delay caused by the processing means. 

5. The delay tracker of claim 1 characterized by means to 30 
determine the amount of delay from said recognized tracker 
pulse. 

6. The delay tracker of claim 1 characterized by the 
addition of means to generate a measure of the delay in 
response to said recognition of said tracker pulse. 

7. The delay tracker of claim 2 characterized by means to 
determine the amount of delay from said recognized tracker 
pulse. 

8. The delay tracker of claim 2 characterized by the 
addition of means to generate a measure of the delay in 
response to said recognition of said tracker pulse. 



as 



9. The delay tracker of claim 3 characterized in that sajd 
use means includes a means to determine the amount of 
delay from said recognized tracker pulse. 

10. The delay tracker of claim 1 characterized in that said 
use means includes means to generate a delay signal in 
response to said pulse detector means. 

11. A method for tracking a delay in a signal processing 
system having a signal having desired substantive informa- 
tion thereon passing through a delay, which delay may 
change due to variations in the signal processing system, 

the method comprising associating a tracker pulse with 
the signal having desired substantive information 
thereon, using • pulse detector means associated with 
the processing system to recognize the tracker pulse to 
develop a determination of said delay in response to 
said tracker pulse. 

12. A method for tracking a delay in a signal processing 
system having a signal having desired substantive informa- 
tion thereon, the signal may have a changing delay, 

the method comprising associating a recognizable tracker 
pulse with the signal having desired substantive infor- 
mation thereon, using a pulse detector associated with 
the processing system to recognize the recognizable 
tracker pulse to develop a determination of said chang- 
ing delay responsive to said tracker pulse. 

13. A method for tracking a delay in a signal processing 
system having an incoming signal having desired substan- 
tive information tbereon passing through a processing means 
having a delay that may change, 

the method comprising using a combiner means to asso- 
ciate a tracker pulse with the incoming signal having 
desired substantive information thereon prior to tho 
incoming signal having desired substantive information 
thereon passing through the processing means, recog- 
nizing the tracker pulse on the signal having desired 
substantive information tbereon coming from the pro- 
cessing means, and using said tracker pulse detector 
means to develop a determination of the delay of said 
tracker pulse to track said delay thai may change. 
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